Stopping times for recurrent Markov processes
نویسندگان
چکیده
منابع مشابه
Markov Decision Processes with Constrained Stopping Times
The optimization problem for a stopped Markov decision process is considered to be taken over stopping times constrained so that E 5 for some xed > 0. We introduce the concept of a randomized stationary stopping time which is a mixed extension of the entry time of a stopping region and prove the existence of an optimal constrained pair of stationary policy and stopping time by utilizing a Lagra...
متن کاملOptimal Stopping Problems for Some Markov Processes
In this paper, we solve explicitly the optimal stopping problem with random discounting and an additive functional as cost of observations for a regular linear diffusion. We also extend the results to the class of one-sided regular Feller processes. This generalizes the result of Beibel and Lerche [Statist. Sinica 7 (1997) 93–108] and [Teor. Veroyatn. Primen. 45 (2000) 657–669] and Irles and Pa...
متن کاملOptimal Stopping Games for Markov Processes
where the horizon T (the upper bound for τ and σ above) may be either finite or infinite (it is assumed that G1(XT ) = G2(XT ) if T is finite and lim inft→∞G2(Xt) ≤ lim supt→∞G1(Xt) if T is infinite). If X is right-continuous, then the Stackelberg equilibrium holds, in the sense that V ∗(x) = V∗(x) for all x with V := V ∗ = V∗ defining a measurable function. If X is right-continuous and left-co...
متن کاملUndiscounted Markov Chain BSDEs to Stopping Times
We consider Backward Stochastic Differential Equations in a setting where noise is generated by a countable state, continuous time Markov chain, and the terminal value is prescribed at a stopping time. We show that, given sufficient integrability of the stopping time and a growth bound on the terminal value and BSDE driver, these equations admit unique solutions satisfying the same growth bound...
متن کاملAsymptotic Exponentiality of First Exit Times for Recurrent Markov Processes and Applications to Changepoint Detection
We study asymptotic properties (as A →∞) of the first exit time from the interval [0, A] of a non-negative Harris-recurrent Markov process. It is shown that under certain fairly general conditions the limiting distribution of the suitably normalized first exit time is exponential E(1) and that the moment generating function converges to that of E(1). The method of proof is based on considering ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Illinois Journal of Mathematics
سال: 1976
ISSN: 0019-2082
DOI: 10.1215/ijm/1256049786